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This  thesis  compared  the  use  of  a  discrete  utterance 
voice  recognition  system  ana  a  keyboard  entry  device  in 
retargeting  Air  Launch  Cruise  Missiles  (ALCM)  prior  to 
launch  from  a  E-5ZG  aircraft.  Time  to  load,  input  and 
output  accuracies,  and  time  versus  accuracy  measurements 
were  made  for  each  of  twenty  subjects.  Keyboard  entry  was 
fcund  to  be  tetter  than  voice  entry  in  time  to  load  and 
input  accuracy.  These  findings  are  limited  to  discrete 
utterance  voice  recognition  systems  and  most  probably  would 
have  been  different  if  a  connected  speech  recognition  system 
had  been  utilized. 

Also  investigated  were  three  display  formats  for 
presenting  flex  targeting  information  on  a  cathode  ray  tube. 
Information  was  updated  on  the  cathode  ray  tube  using 
single-space,  double-space,  and  inverse-video  formats.  Time 
to  update,  input  and  output  accuracies,  and  time  versus 
accuracy  measurements  were  recorded.  No  significant 
differences  were  founi  among  the  three  display  formats. 
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I.   BACKGROUND 

A.   INTRODUCTION 

The  E-52G  was  selected  in  197?  to  be  outfitted  with  an 
all  new  navigation  and  weapons  control  suite  called  the 
Offensive  Avionics  Systerr  (CAS).  This  s/sterr  would  control 
and  launch  the  Air  Launch  Cruise  fissile  (AICM)  .  The  flight 
crews  based  at  the  Boeing  Airplane  Company,  Wichita,  Kansas, 
and  the  human  factors  staff  at  Edwards  AFB,  California,  were 
tasked  to  evaluate  the  OAS .  Based  on  conversations  with 
these  two  groups,  it  was  discovered  that  the  ALCM 
retargeting  procedure,  also  known  as  "flex  targeting",  was 
slow  and  cumbersome. 

The  purpose  of  flex  targeting  is  to  give  political  and 
rrilitary  leaders  greater  flexibility  during  both  strategic 
and  tactical  conflicts.  In  future  warfare,  the  political  as 
well  as  the  military  situation  will  ne  in  constant  flux.  As 
the  situation  rapidly  changes,  targets  will  change  as  well. 
A  commander's  ability  to  change  the  course  of  a  battle  in 
rrinutes  or  seconas  will  oe  dependent  upon  the  ability  of  his 
fcrces  to  respond  to  these  sudden  changes.  This  flexibility 
depends  upon  rapid  weapon  retargeting  which  the  present  OAS 
does  not  provide. 

One  possible  solution  to  this  problem  was  seen  in 
computer   voice   technology.    Work  in  this  area  of  computer 
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vcice  applications  research  is  ongoing  here  at  the  Naval 
Postgraduate  School  by  Dr.  Gary  Poocic.  If  was  felt  that  the 
ALCM  flex  targeting  problem  could  be  easily  investigated 
here  due  to  the  extensive  facilities  of  the  Human  Factors 
Laboratory. 

S.   OAS/ALCM  SYSTEM  IN  E-52G 

1.   Background 

The  B-52  bomber  has  been  in  the  U.S.  Air  Force 
arsenal  since  1954.  Seven  nundred  forty-four  aircraft  were 
produced  through  1962  beginning  with  model  "a"  and  finishing 
with  model  "h".  Today  only  three  models,  the  "d",  "g",  and 
"fi"  remain  in  service. 

All  three  are  assigned  nuclear  and  conventional  roles. 
The  "D"  model,  the  oldest  and  least  modified  of  the  three, 
is  expected  to  be  retired  within  the  next  two  years  and  be 
replaced  by  102  B-1B  aircraft.  (The  USAF  has  designated  the 
cruise-missile-capable  B-l  the  'B-1B'.  It  will  be  equipped 
with  external  cruise  missile  pylons.) 

The  "g"  and  "h"  models  continue  on  active  duty  and  are 
the  subjects  of  many  modifications  to  extend  their  life, 
improve  their  survivability,  and  add  to  the  missions  they 
are  already  expected  to  perform.  This  paper  addresses  a 
rrission  added  recently  to  the  B-E2G,  which  is  presently 
undergoing  modifications  which  will  allow  it  to  carry  the 
Air  Launched  Cruise  Missile  (ALCM). 


12 


2.   Operation 

The  ALCM  is  a  small,  unmanned,  winged  air  vehicie 
capable  of  sustained  subsonic  flight  following  launch  from 
the  B-52G  (see  Figure  1).  Propelled  by  a  turbofan  engine, 
it  incorporates  a  nuclear  warhead  with  a  variable  yield  of 
up  to  2e0  kiiotons  for  a  "hard  target"  kill  capability,  and 
is  programmed  to  strike  a  p re-determined  surface  target 
[Eef.  1] . 

While  the  ALCM  is  onboard  the  B-52G,  it  is  receiving 
position,  beading,  and  altitude  information  from  the 
aircraft's  inertial  navigation  system  every  60  seconds  [Eef. 
2].  When  the  missile  is  activated  for  launch,  it  knows 
where  it  is  and  where  it  is  heading. 

Upon  launch  from  the  B-52G,  ALCM  wing  deployment  is 
attained  within  two  seconds,  and  engine  start  within  three 
seconds.  After  launch,  position,  attitude  and  velocity 
reference  aata  are  derived  from  the  ALCM's  inertial 
navigation  system,  mach  number  and  pressure  altitude  from 
the  air  data  system,  and  height  above  the  terrain  from  the 
radar  altimeter.  Initial  position/velocity  data  and 
atmospheric  parameters  are  transferred  to  the  missile  from 
the  3-5ZG  carrier  immediately  pricr  to  launch.  The  missile 
is  then  guided  inertially  along  preplanned  flight  profiles 
at  programmed  Mach  numbers  and  altitudes.  Velocity  commands 
are  based  on  precomputed  ground  speeds  required  to  reach  the 
target  at  a  specified  time. 


13 


v ^vy'-s^iSP'S'fS's'-:'    ::    s: 


«>«■•&  W<ffi:;; 


SJSSPSS*- 


H 


to 
to 


5_ 
<_> 

x: 
o 

c 


•r— 


en 


ss^-is 


14 


"Time-to-target"  is  calculated  by  the  computer,  and  throttle 
commands  are  issued  as  required  to  maintain  average  ground 
speeds  along  each  trajectory  segment.  Altitudes  are 
selected  to  be  either  "altitude  hold",  where  the  missile 
flies  at  a  commanded  barometric  altitude,  or  "terrain 
following"  where  the  missile  flies  at  a  specified  height 
above  the  terrain. 

Guidance  is  by  a  combination  of  an  inertial  navigation 
system  and  a  terrain  comparison  (TERCOM)  technique  which 
utilizes  the  radar  altimeter  and  onboard  corrputer.  At 
predetermined  points  along  its  flight  path,  the  missile  uses 
its  radar  altimeter  to  map  the  profile  of  the  terrain  below. 
This  "sensed  profile"  is  compared  with  a  preloaded  digital 
map  of  the  surrounding  area.  (Mapping  information  will  be 
furnished  by  the  Defense  Mapping  Agency.)  Locating  itself 
v»ithin  the  map,  the  missile  computer  determines  its  true 
position,  velocity,  and  heading  and  makes  course  corrections 
if  necessary.  At  first  landfall,  the  missile's  map  may  be 
of  an  area  measuring  in  the  tens  of  miles.  When  it  updates 
its  position,  it  also  adjusts  drift  rates,  calibrations,  and 
other  guidance  error  contributions  to  make  itself  less  and 
less  dependent  upon  map-correlation  updates.  The  radar 
altimeter  then  goes  into  "standby"  until  it  enters  the  next 
position  update  area.  Thus,  as  the  missile  proceeds  toward 
its  target  the  maps  would  be  of  smaller  and  smaller  areas, 
since  the  guidance  system   fine-tunes   out   practically   all 
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error.  TERCOM  is  said  to  resoive  objects  on  the  ground  as 
small  as  three  meters  wide  and  30  centimeters  tall  from  an 
altitude  of  several  thousand  meters  [Ref.  3].  The  TIRCOM 
feature  allows  the  ALCM  tc  fly  at  lew  operating  altitudes 
below  100  feet  [Ref.  3].  Maximum  operating  altitude  for  the 
radar  altimeter  is  5000  feet  above  the  ground.  All  terrain 
following  is  performed  below  this  altitude.  In  the  event  of 
radar  altimeter  failure  during  terrain  following,  the 
missile  automatically  transfers  to  the  altitude  hold  mode 
and  flies  at  a  preset  baronetric  altitude  stored  in  the 
mission  software  (Figure  11,  line  #4).  This  value  is 
selected  to  provide  adequate  terrain  clearance  for  the  area 
being  overflown. 

This  high  accuracy  of  missile  position  updating  results 
in  extreme  accuracies  at  the  target.  U.S.  cruise  missiles 
to  date  have  achieved  accuracies  on  the  order  of  30  feet  CEP 
[Ref.  3].  This  means  at  least  5e%  of  the  time  the  missile 
will  lend  within  30  feet  from  the  target. 

The  ALCMs  carried  by  the  B-52G  are  programmed  initially 
with  one  target  per  missile.  Anytime  prior  to  ALCM  launcn, 
a  new  target  can  be  entered  into  the  missile  by  the 
navigator.  This  retargeting  capability  is  referred  tc  as 
"flex  targeting".  Using  the  current  integrated  keyboard 
(1KB),  this  procedure  requires  approximately  1-2  minutes  per 
missile  to  complete.  Retargeting  a  full  load  of  twenty 
missiles  would  require  20-40  minutes. 
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Accelerated  production  for  the  USAF/Boeing  ALCM  at 
production  rates  of  480  missiles  per  /ear  will  start  in 
Fiscal  iyS4.  This  plan  is  predicated  on  the  deployment  of 
3,760  missiles  by  1990  on  a  schedule  consistent  with  B-52G-/H 
conversions  [Ref.  4]. 

3.  Hole  of  Navigator 

Responsibilities  for  navigation  and  weapons  control 
in  the  B-52G  are  assigned  to  the  navigator  and  radar 
navigator.  The  navigator  determines  aircraft  position  based 
on  radar  information  obtained  by  the  radar  navigator.  He 
compares  actual  position,  course,  etc.,  to  preplanned 
mission  course  and  directs  the  aircraft  accordingly.  The 
navigator  is  also  responsible  for  ALCM  status.  If  a  change 
in  ALCM  targets  is  directed  by  appropriate  authorities,  he 
would  be  the  crewmember  to  make  these  changes. 

Except  during  the  flex  targeting  procedure,  there  are  no 
other  inputs  the  navigator  rust  perform  with  regard  to  the 
ALCM.  He  does  have  a  constant  missile  status  of  each,  and 
if  one  malfunctions  prior  to  launch,  it  can  be  withheld  ty 
the  navigator  ana  jettisoned  if  necessary. 

4.  Scenarios:  Tactical  &  Strategic 

The  cruise  missile  carried  onboard  the  3-52G  will  be 
capaDle  of  performing  non-nuclear  (tactical)  roles  as  well 
as  its  main  role  in  nuclear  (strategic)  scenarios. 

In  the  tactical  scenario  rapid  retargeting  of  AICMs 
could   give   defending   forces,   especially   in  the  European 
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Theater,  an  unprecedented  capacity  for  disrupting  Soviet 
Pact  suppiy  lines,  destroying  support  facilities,  and 
attacking  front-line  forces  during  a  massive  thrust  across 
Western  Europe.  A  B-52G  orbiting  outside  the  battle  area 
could  respond  to  battlefield  commanders  by  launching  ALCMs 
against  targets  tec  risky  for  aircraft  strikes,  cr  toe  far 
away  from  artillary  positions.  Since  tactical  targets  are 
very  mobile,  a  rapid  and  accurate  ALCM  retargeting 
capability  is  essential.  If  a  voice  entry  system 
significantly  improved  speed  and  accuracy  then  considerable 
capability  would  be  added  to  the  flex  targeting  option. 

Utilizing  a  nuclear  warhead  in  a  strategic  role,  cruise 
missiles  can  strengthen  the  air  leg  of  the  strategic  triad 
of  the  U.S.  which  includes  intercontinental  ballistic 
missiles  (ICEMs),  submarine  launched  tailistic  missiles 
(SLBPs),  and  strategic  bombers.  ALCMs  will  give  heavy 
bcmDers  a  standoff  capability,  and  the  missile's  long  range 
(1550  miles)  would  lessen  the  need  for  bomber  refueling 
[Ref.  5].  Planners  could  assign  ALCM-equipped  B-52Gs  a 
standoff  role  of  firing  their  missiles  outside  Russian 
airspace  without  actually  penetrating,  or  firing  and  then 
penetrating  to  drop  their  gravity  bombs,  cr  launching  ALCMs 
within  Russian  airspace  as  they  penetrate.  If  the  flex 
targeting  procedure  near  cr  within  these  high  threat  areas 
was  exercised,  the  1-2  minutes  required  for  retargeting  each 
ALCM  would  increase  the  bomber's  probability  of  detection  by 
enemy  radar. 
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C.   SPEECH  RECOGNITION  S.  CRT  DISPLAYS 

1.   Overview 

Ever  since  machines  nave  been  used  by  man,  he  has 
sought  ways  to  have  rrcre  control  over  therr.  With  the 
development  of  computers,  man  continued  to  exercise 
mechanical  control  by  means  of  keyboard  interfaces  or 
manually  punched  cards.  The  ability  to  directly  communicate 
with  them  by  vcice  was  first  envisioned  by  science  fiction 
writers  of  the  1950's  and  60's.  As  the  computer  became 
faster  and  able  to  store  larger  amounts  of  information, 
researchers  began  investigating  the  possibility  of  speech 
recognition  by  computer. 

The  theory  behind  computer  speech  recognition  (also 
known  as  voice  data  entry)  was  simple  enough,  at  least  for 
isolated  words. 

The  basic  theory  is  as  follows: 

1.  Air  pressure  variations,  created  by   speech,  are   first 

converted  into  an  electrical  signal  by  microphone. 

2.  The   signal's   acoustic   features   are   converted   into 

computer   machine   language,   and   stored   in  computer 
memory. 

3.  Because  a  word  does  net  necessarily  have  the  same  length 

each   time   a  speaker  says  it,  the  computer  must  "time 
align"  its  lengtn. 

4.  The  computer  then  corrpares  the  features  of  the  "aligned" 
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word  against  utterances  already  stored  in  its  memory. 
The  computer  decides  whether  the  spoken  word  matches  a 
word  in  memory. 
Assuming  a  match  is  found,  it  then  performs  the  action 
or  actions  (pre-programmed)  corresponding  to  that 
utterance . 


The  computer  thus  recognises  an  utterance,  or  word, 
within  a  given  time  frame.  It  also  rejects  any  word  whose 
features  are  too  remote  from  those  stored  in  its  memory. 

Speech  recognition  car.  be  divided  into  two  types.  The 
first  is  called  'isolated  speech"  or  'discrete"  recognition. 
Each  utterance  is  followed  by  a  0.1-0.2  inter-word  pause. 
In  a  discrete  recognition  system,  the  "utterance"  is  not 
limited  to  just  a  single  word.  £cr  example,  the  Threshold 
T-600  will  allow  utterances  up  to  two  seconds  in  length. 
The  second  type  is  called  "connected  speech"  recognition, 
similiar  to  normal  human  speech  with  no  pauses  between 
words.  Utterances  in  connected  speech  units  can  thus  oe 
maae  up  of  many  individual  words  greater  than  two  seconds  in 
duration. 

When  one  gees  from  computer  recognition  of  individual 
words  (isolated  speech),  to  full  sentences  as  in  natural 
speech  (connected  speech),  the  proolem  is  compounded  even 
mere.  In  isolated  speech  systems,  the  computer  can  clearly 
distinguish  cetween  consecutive  words.  In  contrast,  natural 
speech  wave   foims   do  not  shew  clearly  where  one  wcrd  ends 


ana  the  next  begins,  ana  the  time  alignment  problem  is  far 
more  difficult  with  connected  speech  than  with  isolated 
words.  Net  only  must  the  computer  time-align  individual 
wcrds,  it  must  also  repeat  this  for  groups  of  words  or  whole 
sentences.  Once  an  input  v.crd  is  recognized  in  connected 
speech  systems,  the  computer  must  also  decide  which  word  is 
most  likely  to  follow  the  input  word. 

2.      Value  of  Speech  Recognition  Systems 

Cochran   and   Riley   [Ref.   7]   list   the   following 
advantages  to  computer  voice  entry: 

1.  Fast  learning  time 

2.  Dual  modes  of  sensory  feedback 

3.  Not  restricted  to  one  language 

4.  Accuracy 

5.  Simultaneous:  Use  of  hands,  use  of  eyes,  data  entry 

6.  Automatic  and  multiple  processing 

7.  Remote  entry 

8.  Simple  data  entry 

The  learning  time  on  a  voice  input  device  is  shorter 
than  en  a  keyboard  or  typewriter,  and  accuracy  is  greater 
during  the  iearning  period.  Eecause  spoken  language  is  a 
natural  part  of  life,  data  entry  using  voice  is  easy  once 
the  individual  and  machine  are  trained.  The  auditory  and 
visual  feedback  immediately  reinforce  correct  input  and 
alert  the  operator  to  an  error  [Ref.  7:  p.  190]. 
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Because  the  machine  is  "trained'  tc  each  operator's 
voice,  language  ana  pronunciation  are  not  critical  as  long 
as  the  operator  is  consistent.  This  rreans  that  regional 
accents  and  even  foreign  languages  are  acceptable  for  use 
with  the  voice  input  device  [Ref.  7:  p.  1S1] . 

One  of  the  primary  advantages  of  the  voice  input  device 
is  that  it  frees  the  hanas  and  eyes  for  other  tasks  while 
inputing  data. 

Voice  entry  can  be  useful  when  many  different  or  complex 
characters  need  to  be  entered  in  succession.  The  Threshold 
T-600  can  input  up  to  sixteen  characters  at  once  with  just 
one  utterance. 

3 .   limitations  of  Computer  Speech  Recognition 

Although  the  advantages  are  numerous  and   appealing, 
disadvantages  ana  limitation  also  exist.   These  include: 

1.  Cost  -  Voice  data  entry  devices  vary  in  cost  from  $£00.00 

to  over  $62,000.00.  As  advances  are  made  in  high- 
speed integrated  circuits,  ccsts  will  continue  tc 
decrease . 

2.  Voice  input  can  be  overheard,  rraking  security  a   problem 

[Ref.  S]  . 

3.  Ambient  noise  interference. 

4.  Training  ana  frustration. 

5.  Limited  vocabulary  -  The  user   is   limited   to   only   the 

vocabulary  which  has  been  loaded  into  computer  memory. 

6.  Changes   in  user  voice   characteristics   can   require 

retraining  [Ref  .  9]  . 
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As  in  all  technology,  advantages  and  disadvantages 
exist.  The  final  test  is  always  the  marketplace.  In  both 
civilian  and  military  applications,  voice  units  are 
replacing  more  and  more  conventional  entry  devices. 
Cartography,  air  traffic  control  training,  aircraft  avionic 
systems,  and  military  command  and  control  centers  are  but  a 
few  of  the  present  users.  Industrial  users  are  improving 
production  line  and  shipping  productivity  with  these  devices 
by  as  much  as  40%  [Ref.  10].  The  Navy  is  utilizing  a  voice 
unit  at  their  jleet  Ocean  Surveillance  Information  Center, 
CINCPAC  Fleet,  Honolulu,  Hawaii,  to  query  their  information 
data  base.  General  Eynamics  recently  outfitted  an  F-l€ 
fighter  aircraft  with  a  pilo t-operatea  voice  unit  for 
feasibility  tests. 

4.   CRT  Lisplay  Techniques 

Two  major  classes  of  information  display 
technologies  exist  today:  the  cathode-ray  tube  (CRT)  and  the 
plasma  panel.  The  CRT  has  existed  since  the  1930's  while 
plasma  desplays  were  developed  in  the  late  1960  's .  Both  use 
very  different  techniques  tc  display  information. 

The  CRT  utilizes  an  electron  beem  to  excite  a 
phosphorous  coating  which  in  turn  emits  photons.  Images  can 
then  be  created  by  directing  the  electron  beam  over  the 
phosphorous-coated  glass. 


A  plasma  display  is  similiar  in  principle  to  a  neon 
tube.  It  consists  of  two  parallel  glass  plates  each  with 
rrany  parallel  conductors.  The  plates  are  separated  by  a  0.1 
rrillimeter  gap  filled  with  neon  gas.  A  voltage  between  the 
intersection  of  two  conductors  will  emit  a  glow.  Many  of 
these  points  of  light  can  be  made  to  form  images. 

The  B-52G  displays  were  required  to  display  alphanumeric 
information  as  well  as  the  radar  presentation.  This  meant  a 
display  technique  capable  of  fast  updating,  which  the  plasma 
display  is  unable  to  do  [flef.  11].  Thus,  the  type  of 
display  selected  for  use  on  the  E-52G  was  the  rronochromatic 
CRT.  Methods  of  highlighting  information  en  a  monochromatic 
CRT  include: 
Plashing  -  Turning  displayed   information   on  and   off   at 

approximately  3-5  Hz. 
Inverse  Video  -  Alphanumerics  displayed  as  dark  characters 

over  a  white  background, 
location  -  Position  information  as  in  double-spacing. 
Highlighting  -  Achieved  by  overwriting  with  the  electron  gun 
thus  causing  the  irrage  to  stand  out. 

D.   STATEMENT  OF  THE  PROBLEM 

Part  I  of  this  thesis  evaluates  operator  performance  of 
the  flex  targeting  procedure  using  the  present  integrated 
Keyboard  (IKE)  input  device  and  a  voice  input  device. 
Operator  speed  and  accuracy  were  used  to  evaluate  each 
system.   Would   voice   entry   improve   the   operator's 
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peri'orrrance  as  defined  by  these  parameters?  Each  subject 
used  both  input  devices  in  loading  twenty  AICM  target  sets 
per  device.  A  "target  set"  is  defined  as  the  data  comprised 
of  45  characters  the  ALCM  needs  loaded  in  its  memory  to  fly 
to  and  locate  the  target  (Figure  11). 

Part  II  compares  the  way  in  which  this  information  is 
presently  displayed  (single-spaced)  on  the  navigator's  CRT 
with  twc  alternative  methods  of  presentation.  These  two 
alternatives  are  double-spacing  and  inverse-video. 
Characters  displayed  in  inverse-video  are  shown  as  dark 
figures  against  a  white  background.  Normally,  characters 
are  displayed  as  white  characters  ever  a  blac£  background. 
During  the  inverse-video  portion  of  Part  II,  as  a  line  is 
updated,  that  line  is  "inverse-videoed"  when  reinserted  into 
the  target  set.  It  was  hoped  that  this  would  help  the 
operator  in  scanning  the  target  set  in  search  for  values  to 
oe  changed  out. 

A  capability  of  exercising  the  flex  targeting  option 
using  voice  input  might  significantly  reduce  bomber  exposure 
in  enemy  airspace,  while  giving  military  and  civilian 
leaders  more  time  for  retargeting  decisions  based  on 
reconnaissance,  changing  military  and  political  factors, 
etc.  The  method  of  displaying  the  flex  targeting  data  on 
the  CRT  could  alsc  have  a  similar  effect. 
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I.   HYPOTHESES 

The  following  hypothesis  were  tested: 

1.  Eypothesis  Regarding  TIME 

H   :   There  is  no  difference  in  Tine  to 
o 

enter  corrplete  target  sets  among 
the  two  entry  rrodes. 
H   :   Complete  target  sets  will  be  entered 
faster  using  the  voice  entry  rrode  . 

H   :   There  is  no  difference  in  Tirre  to 
o 

verify  and  correct  target  sets  among 
the  three  types  of  display  formats. 
H   :   Target  sets  will  be  verified  and  corrected 
fastest  using  the  inverse-video  format. 

2.  Hypothesis  Regarding  ACCURACY 


H   :   There  is  no  difference  in  the  Accuracy 
o 

of  target  sets  among  the  two  entry 
modes . 
H   :   Target  sets  will  he  entered  more 

accurately  using  the  voice  entry  mode. 


H_  :   There  is  no  difference  in  Accuracy  in 
verifying  and  correcting  target  sets 
among  the  three  types  of  display  formats 

H   :   Target  sets  will  be  most  accurately 

verified  and  corrected  using  the  inverse- 
viaec  format. 
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II  .   DESCfllPTION  OF  THE  ZXPZPirSNT 

A.   OBJECTIVES  AND  CONSTRAINTS 

The  purpose  of  this  experiment  was  twofold.  First,  to 
determine  whether  computer  voice  technology  was  better  than 
keyboard  entry  for  loading  tne  ALCM  flex  targeting  data. 
The  performance  of  both  entry  methods,  computer  voice  end 
the  integrated  keyboard  (IKE),  i«ould  be  measured  by  subject 
input  speed,  accuracy,  and  time  versus  accuracy.  Second,  to 
determine  which  of  three  methods  of  data  presentation  on  the 
CHT  would  te  best  suited  for  the  flex  targeting  procedure. 
The  performance  of  each  display  presentation  would  be 
determined  by  sucject  input  speed,  accuracy,  and  time  versus 
accuracy  in  chan6ing  displayed  flex  targeting  data. 

An  effort  was  made  to  reconstruct  the  B-52G  navigator's 
workstation  in  carrying  out  these  objectives.  Only  ALCM 
related  controls  and  displays  were  incorporated  into  the 
moc£up  (see  Figure  2). 


B.   EQUIPMENT 

1.   Navigator  Position 

For  the  purpose  of  this  thesis  we  will  assume 
through  some  ccmmunicat  ions  means  the  B-52G-  crew  can 
successfully  receive  new  ALCM  targeting  information  from 
higher  authorities.  Also  assumed  is  that  the  information 
can  be  readily  decoded  and  handed  to  the  navigator  in   paper 


fcrm  which  will  then  De  manually  entered.  intc  the 
appropriate  ALCP  .  The  Keyboard  the  navigator  would  use  is 
unique  to  the  B-52G .  It  interfaces  with  the  Offensive 
Avionics  Systerr  (OAS)  which  controls  both  navigation  and 
weapons.  Both  navigator  and  radar  navigator  have  a  keyboard 
as  well  as  two  cathode-ray  tube  (CRT)  displays  for  each  of 
their  posticns  (see  Figures  3,4).  In  actuality,  either 
operator  can  change  ALCI*  target  information.  But  in  most 
cases,  and  for  the  purpose  of  this  thesis,  the  navigator 
will  carry  out  the  procedure  (see  Table  I). 

In  simulating  the  operation  of  this  crew  position  at  the 
Human  Factors  Laboratory,  an  APPLZ  II  "plus"  64K 
rinicomputer  and  a  CONRAC  7x5  inch  CRT  display  were 
positionei  in  front  of  ana  above  the  subject's  seat 
position.  A  keyboard  was  built  to  lock  and  operate  like  the 
integrated  keyboard  (1KB)  founc  currently  in  the  B-52G. 

The  navigator's  position  dimensions  and  equipment 
location  for  this  experiment  were  obtained  from  the  OAS- 
configured  T-l£  navigation  simulator  located  at  Wright- 
Patterson  Air  Force  Base. 

2.   Integrated  Keyboard  (IO) 

In  order  to  measure  target  set  entry  times  by 
keyboard,  a  working  model  of  the  1KB  used  in  the  B-52G  was 
built.  Its  dimensions  ani  pertinent  Keys  were  duplicated 
exactly  (see  Figure  5,6).  The  1KB  was  connected  via  a  Lear 
Siegler  Inc.  AEM-3A  terminal  to  an  APPLE  II  minicomputer. 
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The  A2M-3A  was  needed  because  the  APPLE  II  design  did  not 
allow  direct  connection  or  the  1KB  to  the  APPLE  II  's 
Keyboard  plug  directly. 

3.  Apple  II  Computer 

An  APPLE  II  "plus"  64K  RAM  (Random  Access  Memcry) 
rrinicorrputer  was  used  to  control  all  video  displays  on  the 
CONRAC  CRT  (see  iigure  7).  As  eacn  subject  entered  target 
set  data,  the  information  was  stored  in  rain  memory  to  he 
printed  cut  after  the  session  using  a  MICRCLINE  Micron  £0 
printer.  These  printouts  were  later  used  to  check  for  input 
errors  . 

4.  Voice  Recognition  System:  T600 

A  Threshold  Technology  Inc.  T-620  (hereafter 
referred  to  as  the  T60&)  was  used  as  the  voice  recognition 
input  device  (see  Figure  8).  It  is  a  commercially  available 
device  capable  of  recognizing  up  to  2156  spoKen  words  or 
phrases.  These  phrases  or  utterances  as  they  are  called 
must  be  limited  to  0.1-2.0  seconds  in  length  [Ret .  12]. 

A  short  pause  of  at  least  0.1  second  is  required  between 
each  utterance.  Thus  the  T600  is  referred  to  as  an  isolated 
or  discrete  speech  voice  recognition  unit.  The  T620  voice 
recognition  system  consists  of  a  main  terminal  processor 
unit  containing  a  speech  preprocessor  and  microcomputer. 
The  remaining  components,  the  tape  cartridge  unit,  the 
microphone  preamplifier  and  display  (present  but  not  used 
during  experirent)  are  connected  separately. 
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The  micrcphcne  used  was  a  ncise  cancelling  SHURS  SM-10.  The 
T600  was  connected  to  the  APPLE  II  via  an  APPLE  serial 
interface  with  RS-232  standard  input /output  . 

When  the  T600  receives  an  utterance  spoken  by  a  subject, 
the  voice  unit  will  react  ia  one  of  two  ways.  The  utterance 
will  be  compared  with  those  patterns  in  memory,  and,  if  a 
matcn  is  found,  the  corresponding  output  string  will  be 
transmitted.  The  alternative  is  that  no  match  will  be  found 
between  the  utterance  received  by  the  T600  and  that 
programmed  in  its  memory.  If  the  latter  occurs,  an  audible 
""beep"  is  sounded  with  no  output  string  transmitted.  This 
is  referred  tc  as  a  nonreccgnit icn .  It  can  result  from 
either  mispronunciation  of  the  utterance,  poor  initial 
training  of  the  word,  background  ncise  being  interpreted  by 
the  T600  as  an  utterance,  or  lack  of  T602  reliability. 

C.   SUBJECT  SELECTION  ANE  TRAINING 
1.   Subject  Selection 

Subjects  used  for  this  experiment  were  students  and 
faculty  of  the  Naval  Postgraduate  School.  Four  were  female 
and  sixteen  male.  All  except  five  had  nc  previous 
experience  with  voice  entry  and  none  had  used  a  P-52G  IKE 
pricr  tc  this  experiment.  Seventeen  were  active  duty  U.S. 
military  officers  and  three  were  civilians. 
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2.  T600  Vocabulary  Training 

Before  the  T600  could  be  used  as  an  input  device  in 
place  of  the  IKE,  voice  patterns  for  all  input  commands  had 
to  be  recorded  into  the  T600's  memory.  This  is  referred  to 
as  "training".  Subjects  would  repeat  each  of  the  twenty 
vocabulary  words  (see  Appendix  A)  ten  times  into  the 
microphone.  The  microcomputer  within  the  T600  averages  the 
ten  utterances  into  one  digital  pattern  of  that  word.  This 
training  was  done  for  each  of  the  twenty  words.  Each 
vccaoulary  word  had  a  corresponding  output  string.  Thus,  if 
the  T600  recognizes  an  utterance  as  "zero",  it  would  output 
a  "0",  and  so  on.  The  output  string  in  the  T600  can  be  up 
to  sixteen  characters  in  length. 

After  the  twenty  words  were  trained,  each  was  repeated 
three  times  to  confirm  the  T600  was  able  to  identify  them. 
If  a  misrecogni ti on  or  a  nonrecogni t ion  ("beep"  sound) 
occurred  2  out  of  3  times  or  greater  for  a  given  word,  it 
was  retrained. 

3.  Integrated  Keyboard  Training 

All  subjects  had  never  seen  an  1KB  before 
participating  in  this  experiment.  As  stated  in  the  "Script 
And  Instructions  To  Subjects"  vsee  Appendix  B),  the 
operation  of  the  1KB  was  shown  to  each  subject  and  each  was 
allowed  unlimited  practice  using  a  sample  computer  program 
until  they  felt  corrf ortaole  with  the  1KB. 
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D.   DEPENDENT  VARIABLES 

The  following  Variables  were  calculate!  for   each   group 

of  20  targe i  sets: 


%    Input  Accuracy  Typing  (IAT) 


NCE 


NCE  +  NICE  *    NME 


x  100 


%   Cutput  Accuracy  Typing  (CAT) 


NCC 


NCC  +  NIC  +  NMC 


x  130 


%  Input  Accuracy  Voice  (IAV) 


NCE 


NCE  +  NICE  +  NME 


x  100 


%  Cutput  Accuracy  Voice  (CAV) 


NCC 


NCC  4  NIC  +  NMC 


x  100 


Legend:    NCC  :  Number  of  Correct  Characters  =  4£/target  set 

NMC  :  Number  of  Missing  Characters  (san-e  as  NME) 

NIC  :  Number  of  Incorrect  Characters 

NCE  :  Number  of  Correct  Intries  =  68  irax/target  set 

NME  :  Number  cf  Missing  Entries  (same  as  NMC) 

NICE  :  Number  of  Incorrect  Entries 


Character  -  Displayed  entries  which  are  ultimately  lead,  ec! 
into  the  ALCM. 

Entry  -  An  input  which  may  or  may  not  be  ultimately  loaded 
into  the  ALCM. 


7~u 


NCI 

%   Correct  Entries   =  x  100 

NME  +  TNE 


legend:        NC5    :    Number    of   Correct    Entries   =   68    rax/target    set 
NM1    :    dumber    cf   Missing   Entries    (same    as    NMC ) 
TNE    :    Total    Nurrber   of    Intries    = 

NCE  +  NICE  +  NEUTCE 


Character  -  Displayed  entries  which  are  ultimately  loadei 
into  the  ALCM. 

Entry  -  An  inout  which  may  or  may  not  be  ultimately  leaded 
into  the  ALCM. 


E.   EXPERIMENTAL  DESIGN  AND  PROCEDURE 

Each  subject  first  performed  Part  I,  the  "Target  Loading 
Task",  in  \vhich  he  first  entered  2?  ALCM  target  sets 
beginning  with  either  the  Integrated  Keyboard  (1KB)  or  the 
T6£0  voice  input  device  (see  Appendix  C  for  subject  order). 
Part  I  of  this  tnesis  was  a  two-way  design  as  illustrated  in 
Eigure  9.  Subject  order  with  the  two  conditions  was 
determined  using  an  ABBA  ordering  method.  This  was  repeated 
using  the  second  entry  method  with  the  sarre  target  sets. 
Performance  cf  each  subject  was  recorded  using  data  sheets 
shown  in  Appendix  D.  The  twenty  target  sets  used  in  Part  T 
are  contained  in  Appendix  E. 

Part  II  was  a  two-way  design  as  illustrated  in  Eigure 
10.  This  part  cf  the  thesis  was  called  the  "Target 
Information  Verification  TasK*'.  Here  the  subject  was 
required  to  examine  each  cf  eighteen  target  sets  ,  ordered  in 
three  groups  of  six  ,  which  haa  ceen  preloaded  by  the  author 
(  see  Appendix  F) . 


VOICE 


IKE 


S 
U 
B 
J 
E 
C 
T 
S 


4 

5 

6 

7 

6 

9 

10 

11 

12 

13 

14 

It 

ie 

17 
16 
19 
2£ 


TARGET  LOADING 
TASK 

CONCEPTUAL  LESIGN  ^PART  I) 


Eigure  y 

He  then  compared  each  lo  a  list  in  which  various  characters 
hea  been  changed.  Changes  varied  from  0  to  9  characters  per 
set.  Some  target  sets  required  no  corrections,  while  ethers 
required  many  (see  Appendix  G).  The  subject  had  to  locate 
each  value  in  the  target  set  tc  oe  changed,  and  ma  ice  the 
required  changes  (see  Figure  11).  Only  the  Integrated 
Keyboard  (1KB)  was  used  as  tne  entry  device  for  Part  II. 
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SINGLE-SPACE    DOUELE-SPACE    INVERSE-VIDEO 
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B 
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E 
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S 
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13 
14 
15 

ie 

17 

ie 

lb 
20 


TARGET  INFORMATION  VEPIFICATICN  TASK 
CONCEPTUAL  DESIGN  (PART  II) 

Figure  10 

Each  of  the  three  groups  of  six  target  sets  required,  a  total 
of  26  randomly  distributed  changes  per  grcup.  ^roup.  The 
first  set  of  six  target  sets  was  displayed  in  a  single- 
spaced  format  as  is  presently  dene  in  the  B-52G  'Fig.  11). 
The  second  set  of  six  was  displayed  in  aou tie-spaced  form. 
The  third  set  cf  six  was  displayed  single-spaced,  but  as  s 
line  was  modified,  that  line  tben  became  displayed  in 
inverse-7 idee  fcrm.  Characters  displayed  in  inverse-video 
are  shown  as  darfc  figures  against  a  white  "background.  For 
details  of  the  experimental  prccedure,  see  Appendix  B. 
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I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  !  I  I  I  I  I  I  I  I  !  I  I  I  I  I  I  I 
I  I 

I  I 

FLEX  TARGETING 


1  N000££000   < target  latitude 

£  E000000000   < target  longitude 

3  0000000002   < \ 

4  000000000Z0  < \ 

t   00000       < \flightpath  information 

required,  by  ALCM 


MCTIFY  N000f0e000  < line  #1  ready 

"V  to  te  modified 

i        N cursor  I 

i  i 

i  i 

I  I  I  I  !  I  I  I  I  !  I  I  I  I  I  I  I  I  I  I  I  I  I  [  I  !  I  M  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 
I  I  I  t  I  '  I  I  I  I  I  I  I  I  I  I  I  !  I  1  I  I  I  I  1  I  I  I  I  I  I  I  I  I  I  I  I  I  I  1  1  1  I  I  I  I  I  I  I  I  I  I 


TARGET  SET  FORMAT  CURRENTLY  USEE  FOR  FLEX  TARGETING 
(Adapted  from  Reference  6) 


FIGURE  11 
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ALCM  LOCATION  ANE  IDENTIFICATION  CODES 


Figure  12 
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TAiiLE  I 


RETARGETING  PROCEDURE 


ACTION  RESPONSE 


1.  Desired  ALCK  is  selected     1.  CRT  in  front  of  nav- 
by  navigator.  igator  displays  target 

information  as  shown 
in  Figure  11. 

Z.    Line  #1  is  selected  to  be    2.    Line  #1  is  repeated  at 

changed,  bottom  of  CRT  ready  to 

be  changed  as  shown  in 
figure  11. 

3.  New  data  is  entered  using    3.  New  line  *l  appears  at 
Keyboard  for  line  #1 .  bottom  of  CRT  as  it  is 

typed,  overwriting  the 
original  line  #1 . 

4.  New  line  #1  is  completed;     4.  Ola  line  pi    is  replaced 
"ENTER"  button  is  pressed.      by  new  line  #1. 

t.    Line  PZ    is  selected  tc  be    5.  Line  #2  is  repeated  at 
changed.  bottom  of  CRT  ready  to 

be  changed  . 


This  procedure  is  continued  until  all  five  lines  have  been 
changed  out.  After  the  last  line  (  #5  )  has  been  entered, 
the  ALCr*!  is  ready  for  launch  against  its  new  target. 
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In  Parts  I  and  II,  subjects  called  up  each  target  set  as 
is  done  in  the  B-52C-  using  a  let ter-numcer  combination.  The 
six  ALCMs  stored  under  the  left  aircraft  pylon  are  referred 
to  as  Al  through  A6 .  The  eight  stored  in  the  bcmt  bay  are 
referred  to  as  El  through  BS.  The  six  ALCMs  stored  under  the 
right  aircraft  pylon  are  referred  to  as  Cl  through  C6. 
Figure  12  shows  pictorally  the  identification  and  position 
of  each  ALCM . 
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III.   RESULTS 


A.   INTRODUCTION 

Results  for  Fart  I  (Target  Leading  Task)  and  Part  II 
(Target  Information  Verification  Task)  will  be  discussed 
separately.  For  each,  the  results  are  suodivided  into  Tire, 
Input  and  Output  Accuracies,  and  Tirre  versus  Accuracy.  Paw 
data  analyzed  in  this  section  is  contained  in  Appendixes  H 
ard  I  . 

5.   RESULTS  SOP  PART  I 
1  .   Tirre 

Figure  13  is  a  plot  showing  the  tirre  required  for 
each  subject  tc  load  all  twenty  target  sets.  Keyboard  entry 
was  faster  than  the  voice  entry  technique  for  fifteen  of  the 
nineteen  subjects.  No  difference  was  noted  in  the  time  tc 
complete  using  either  technique  for  one  subject,  while  voice 
entry  was  faster  for  turee  subjects.  The  five  subjects  at 
the  far  right  of  the  graph  had  previous  experience  with 
voice  entry.  Analysis  of  Mgure  13  indicates  no  marked 
difference  among  those  with  prior  voice  entry  experience. 
Mean  and  standard  deviation  for  the  voice  data  are  27.56  and 
3.42  respectively.  Mean  ana  standara  deviation  for  the  IKE 
data  are  24.64  and  5.1b  respectively. 
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Time 
(Minutes) 


V  =  Time  (nearest  min.)  for  Voice 

£  =  Time  (nearest  min.)  for  1KB 

B  =  Voice  Time  =  IKE  Time 

*  =  Previous  experience  with  Voice  Entry 
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SUBJECTS 


Figure  12.  Tine  by  Subject 
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TABLE  II 
ANALYSIS  CF  VARIANCE:  SUEJECT  EY  TIME  -  PART  I 


SOURCE 
Between  Subjects 
Between  Methods 
Error 
Tctal  810.52    39 


SS 

df 

MS 

$ 

P 

412.43 

19 

21.71 

1.32 

ns 

Sb.24 

1 

65.24 

5.  IE 

<.05 

312.84 

19 

16.47 

The  Integrated  Keyboard  input  method  proved  to  be 
significantly  quicker  tnan  the  voice  method  as  shewn  in 
Table  II  (P  <.0£). 

2.   Input  Accuracy 

Figure  14  shows  Subject  by  Percent  Input  Accuracy. 
The  IK3  percent  input  accuracy  was  higher  for  74  percent  of 
the  subjects.  Voice  was  tetter  for  26  percent.  This  was 
confirmed  using  an  Analysis  of  Variance  shown  in  Table  III. 
1KB  input  accuracy  was  significantly  better  (P  <  .01)  than 
voice  entry.  (In  order  to  r.eet  requirement s  regarding  the 
distributions  of  the  data,  an  arc-sine  transformation  was 
applied  to  the  percent  input  accuracies  prior  to  performing 
the  Analysis  of  Variance.) 
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TABLE  III 

ANALYSIS  C5  VARIANCE:  SUBJECT  BY  INPUT  ACCURACY  -  PART  I 

SOURCE 
Between  Subjects 
Between  Methods 
Errcr 
Total 


SS 

df 

MS 

V 

0.5759 

19 

0.0303 

1.31 

0.2538 

1 

0.2538 

10.99 

0.4383 

19 

0.0221 

1  .£682 

39 

3.  Output  Accuracy 

Figure  15  shows  Subject  versus  Percent  Output 
Accuracy.  Analysis  or  Variance  in  Table  IV  confirmed  no 
significant  difference  between  voice  and  1KB  percent  output 
accuracies  existed.  (In  order  to  rreet  requirements 
regarding  the  distributions  of  the  data,  ar.  arc-sine 
transformation  was  applied  to  the  percent  output  accuracies 
pricr  tc  performing  the  Analysis  of  Variance.) 
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Percent 

Input 
Accuracy 


V 
K 
E 
* 


Input  Accuracy  Vcice 

Input  Accuracy  Keyboard 

Voice  In. Ace.  =  Keyboard  In. Ace 

Previous  Experience  With  Vcice 


100  - 


95 


c  _ 


90  - 


85 
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i  _  i  _  i  _  i  _  i  _  i i i i i i 
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4  5  6  7  8  9  10  l£  14  16  16  20  11  13  15  1?  19 

)jC  3QC            SQK  3fC           901 


12   2 


SUBJECTS 


figure  14.  Input  Accuracy  by  Subject 
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TABLE  IV 
ANALYSIS  01  VARIANCE:  SUBJECT  BY  OUTPUT  ACCURACY  -  PART  I 


SOURCE 

SS 

df 

MS 

F 

P 

Between  Subjects 

0.7946 

iy 

0.0416 

<1 

ns 

Between  Methods 

0.2214 

l 

0.0214 

<1 

ns 

Error 

1 .05yb 

iy 

0.05S6 

Total 

1.8755 

zy 

4.   Time  Versus  Accuracy 

Figures  16  through  19  show  Input  and  Output 
Accuracies  plotted  against  Time  for  Doth  voice  and  1KB  entry 
methods.  Figure  16  shows  no  apparent  tradeoff  between 
Percent  Input  Accuracy  and  Time  for  voice  entry.  However, 
Figure  17  through  19  show  pronounced  increases  in  accuracies 
as  time  to  complete  the  task  increased. 


Percen  t 
Output 
Accuracy 


V  =  Output  Accuracy  Voice 

K  =  Output  Accuracy  Keyboard 

E  =  Voice  Out. Ace.  =  Keyboard  Out. Ace 

*  =  Previous  Exuerience  With  Voice 


100  -  V  K--B 
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Figure  15.  Output  Accuracy  by  Subject 
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Figure  16.  Percent  Input  Accuracy  by  Tire 

For  Voice 
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figure  17.  Percent  Input  Accuracy  by  Time 

For  1KB 
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Figure  IS.  Percent  Output  Accuracy  by  Time 

For  Voice 
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Figure  19.  Percent  Output  Accuracy  "by  Tin'e 

Fcr  1KB 
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C.   RESULTS  FOR  PART  II 
1.   Time 

Figure  20  shows  average  times  for  each  of  the  three 
display  forirats  tested.  Analysis  of  Variance  between  the 
three  display  formats  shewn  in  Table  V  indicated  no 
significant  differences.  However,  a  significant  difference 
between  subjects  (P  <.01)  was  detected. 


TABLE  V 

ANALYSIS  OP  VARIANCE:  TIME 
EY  DISPLAY  FOHMATS  -  PART  II 


SOURCE 

SS 

df 

MS 

F 

p 

Between  Subjects 

37.52 

19 

1.97 

4.48 

<.01 

Between  Methods 

1  .15 

2 

0.57 

1  .30 

ns 

Error 

16.76 

3£ 

0.44 

Total 

59 

58 
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figure  20.  feari  Time  And  Standard  Deviation  tc 
Complete  Update  Using  Each  Display  Format 
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2.   Input  Accuracy 

Figure  21  shows  Mean  Input  Accuracy  plotted 
against  each  Display  icrmat.  Nc  significant  difference  was 
found  between  display  formats  as  shown  in  the  Analysis  of 
Variance  in  Table  VI.  (In  order  tc  meet  requirements 
regarding  the  distributions  of  the  data,  an  arc-sine 
transformation  was  applied  tc  the  percent  input  accuracies 
prior  to  performing  the  Analysis  of  Variance.) 


TABLE  VI 

ANALYSIS  OF  VARIANCE:  SUBJECT  BY 
INPUT  ACCURACY  -  FART  II 


SOURCE  SS     df      MS        F        P 

Eetween  Subjects      0.9406   19    0.0495    1.10      ns 
Between  Methods       0.0223    2    0.0116     <1       ns 
Error 
Total 


SS 

df 

MS 

F 

0  .9406 

19 

0.0495 

1  .10 

0  .0233 

2 

0.0116 

<1 

1.7105 

36 

0.0450 

2.6746 

59 

60 
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Figure  21.  Mean  Input  Accuracy  And  Standard  Deviation 

For  Fach  Display  Format 
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3.   Output  Accuracy 

Figure  22  shows  Mean  Output  Accuracy  plotted 
against  each  Display  Format.  No  significant  differences 
were  computed  as  shewn  in  the  Analysis  of  Variance  in  Tatle 
VII.  (In  order  to  meet  requirements  regarding  the 
distributions  of  the  data,  an  arc-sine  transformation  v/as 
applied  to  the  percent  output  accuracies  prior  to  performing 
the  Analysis  of  Variance.) 


TABLE  VII 

ANALYSIS  CF  VARIANCF:  SUBJECT  BY 
OUTPUT  ACCURACY  -  PART  II 


SOURCE 

SS 

df 

MS 

F 

? 

Eetween  Subjects 

2.610 

iy 

0.126 

1  .64 

ns 

Between  Methods 

e.e96 

2 

0 .  046 

<1 

ns 

Error 

3.189 

36 

0.084 

Total 

5. 69* 

59 
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Figure  22.    Mean  Output  Accuracy  And  Standard  Deviation 

For  Each  Display  Format 


4.   Time  Versus  Accurac; 


Analysis  of  Variance  for  subject  ti^es  and  input  and 
output  accuracies  shewed  nc  significant  differences. 
However,  plots  of  Percent  Input  Accuracy  versus  Tirre  for  the 
three  display  formats  indicate  the  dcu tie-space  format 
resulted  in  the  best  percent  input  accuracy  over  time. 


63 


Percen t 

Input 
Accuracy 

100    - 


y0   - 


80 


i i i i 


IX 


i i 


XXX  X 

X  XX  XX  X 

X 
X 

X 
X 


I I  I         I  I  I  l_l_l_l l_l 


I         I         I         I         1         I         I         I         I         I         I         I 


I         I 


T  i  it  e    ( rr  i  n  .  ) 

Figure   23.    Percent    Input    Accuracy    Dy   Tirre 
(S  ingle-Spece ) 


Figures  23  and  25  show  data  scattered  over  wider  ranges  as 
compered  with  rigure  24  wnich  shows  good  clustering  above 
the   95   percent    level. 
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iigure  24.  Percent  Input  Accuracy  by  Tirre 
(Double-Space ) 
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Figure  25.  Percent  Input  Accuracy  by  Tirre 
( Inverse-Video ) 


An  examination  of  the  Percent  Cutput  Accuracy  by  Time 
plots  shewed  no  significant  grouping  of  the  data  in  all 
three  display  formats. 


IV.   CONCLUSIONS  AND  RECOMMENDATIONS 

A.  GENERAL 

The  purpose  of  this  thesis  has  been  twofold.  Part  I 
investigated  the  use  of  a  discrete  voice  entry  system  in 
loading  Air  Launch  Cruise  Missile  (ALCM.)  target  information. 
A  direct  comparison  was  made  between  voice  entry  and  the 
integrated  keyboard  (IKE)  presently  operational.  Time  to 
lead,  input  and  output  accuracies,  and  time  versus  accuracy 
measurements  were  recorded  for  each  of  the  twenty  subjects. 

Part  II  investigated  three  means  of  displaying  the  ALCM 
target  information  on  a  CRT.  Information  was  updated  using 
single-spaced,  double-spaced,  and  inverse-video  formats. 
Only  the  IKE  was  used  in  Part  II.  Time  to  update,  input  an 
output  accuracies  and  time  versus  accuracy  measurements  were 
recorded  for  each  subject. 

B.  CONCLUSIONS 
1 .   Part  I 

It  had  been  hypothesized  that  target  sets  would  be 
entered  faster  using  the  voice  entry  method.  However,  the 
IKE  was  significantly  faster  (P  <  .05)  than  the  voice 
method.  It  was  suspected  that  this  may  have  teen  due  in 
part  to  first  time  use  of  the  voice  entry  device  by  fifteen 
out  of  twenty  subjects.  Due  to  experimental  time 
constraints,  subjects  had  at  most  15-30  minutes  to   practice 
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with  voice  entry  prior  to  running  the  experiment.  However, 
analysis  of  Figure  13  shows  that  only  two  out  of  the  five 
subjects  with  prior  voice  entry  experience  accomplished  data 
entry  quicker  using  voice.  Thus,  prior  exposure  to  voice 
did  not  improve  subject  entry  times.  It  should  be  noted 
that  despite  slower  input  speeds  using  voice  entry,  60 
percent  of  the  subjects  preferred  voice  entry  use  over  the 
1KB. 

It  should  be  noted  that  a  discrete  voice  unit  was  used 
fcr  this  experiment.  However,  a  "connected  speech" 
recognition  unit  would  have  Deen  more  appropriate  for  this 
task,  and  probably  would  have  shewn  faster  input  times.  A 
connected  speech  system  is  able  to  receive  multiple  inputs 
at  ence,  ie.,  "1-4-3-2-5",  with  no  pause  between  utterances. 
This  more  natural  speech  would  be  more  comparable  with 
Keyboard  entry  than  the  discrete  voice  entry.  Unfortunately 
such  a  system  was  not  available. 

It  was  hypothesized  that  target  sets  would  be  entered 
rrore  accurately  using  the  voice  entry  method.  The  IKE  was 
significantly  higher  in  input  accuracy  (P  <  .01)  than  voice 
entry.  Thus  fewer  corrections  were  rrade  to  data  on  the 
screen  before  committing  it  to  the  weapon  using  the  IKE 
entry  technique  rather  than  voice  entry. 

Another  factor  which  effected  input  accuracy  was  the 
training  of  the  voice  unit  by  the  subject.  Sa-ch  utterance 
was  repeated  three  times  in  order  to  detect   poor   training. 
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If  the  voice  unit  had  problems  recognizing  an  utterance 
either  after  training  or  during  practice,  that  word  was 
retrained.  In  many  instances  it  was  not  ncticed  until  well 
into  the  experiment  that  certain  words  had  either  teen 
pccrly  trained  or  were  being  pronounced  differently  by  the 
subject.  Changes  in  pronunciation  may  also  be  attributed  to 
the  stress  imposed  by  the  experiment  which  was  not  present 
during  the  vocabulary  training  session.  Begardless  of  the 
explaination,  subjects  rrade  less  errors  using  the  1KB  method 
of  entry. 

No  significant  difference  in  the  output  accuracy  existed 
between  input  devices.  This  indicates  the  data  was  checked 
equally  well  by  each  subject  prior  to  entering  the  data  and 
moving  on  tc  the  next  weapon,  irrespective  of  entry 
technique. 

No  apparent  tradeoff  was  noted  between  Percent  Input 
Accuracy  and  Time  for  voice  entry  (see  Figure  16).  However, 
pronounced  increases  in  accuracy  were  noted  for  Percent 
Input  Accuracy  by  Time  using  the  1KB  (see  Figures  17). 

Possible  fatigue  was  suspected  during  the  voice  entry 
portion  in  Part  I.  Subsequent  analysis  of  all 
misrecognitions  and  nonrecogni tions  over  the  twenty  target 
sets  shewed  an  increase  in  average  errors  as  the  the 
experiment  progressed,  but  this  increase  was  not 
statistically  significant  (see  Table  XIII). 
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2.   Part  II 

It   was   hypothesized   that   target   sets   would   be 

verified   and  corrected   quickest  and  most  accurately  using 

the  inverse-video  format.   Analysis   showed   no   significant 

differences   in   time,   input  or  output  accuracies,  and  time 

versus  accuracy  between  the  three   display   formats   tested. 

This  was  rather  suprising.   It  was  originally   telieved   the 

single-space  format  would  require  much  mere  time  and   induce 

more   errors   than   the   other   two  methods.    There   i*ere 

differences  in  subject  preference  among   the   three   display 

formats.    The   double-space   format  was   preferred   by  65 

percent,  as  compared  with  20  percent  for   the   inverse-video 

and  15  percent  for  the  single-space. 

C.   RECOMMENEATIONS 

Based  on  the  data  in  Part  I  it  can  be  concluded  that 
while  voice  entry  is  definitely  preferred,  the  IKE  is 
superior  in  entry  speed  and  input  accuracy.  Due  to  limited 
resources,  this  thesis  had  enly  a  discrete  voice  entry 
device  to  measure  against  an  1KB.  It  is  the  author's 
opinion  that  a  ccnected  voice  unit  would  have  shown  much 
greater  input  speeds  than  the  discrete  unit  used  here. 
Thus,  voice  applications  in  areas  requiring  quick  leading  of 
single  characters  should  loo£  toward  the  continuous  voice 
systems  for  improvenent  over  conventional  keyboard  entry 
devices . 
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While  there  was  no  significant  difference  among  the 
three  display  formats,  it  is  suggested  that  the  double-space 
display  format  tie  used.  Use  of  this  format  would  incur  no 
additional  cost  and  would  satisfy  user  preference. 

It  might  be  desirable  tc  compare  the  effectiveness  of 
the  three  display  formats  under  subject  posed  and 
experimenter  posed  conditiors.  Thus,  the  effect  of  stress 
could  be  simulated. 

A  brief  examination  of  nonrecognitions  in  Table  XIV 
indicated  that  the  terms  0,  £,  4,  and  5  were  more  often  not 
recognized  than  the  other  numerical  terns.  A  %,  was 
performed  on  the  frequencies  observed  for  the  0  through  y 
entries  and  a  %  value  of  137.53  v*as  obtained  (10  df,  P  < 
.001).  The  0  through  9  values  had  been  drawn  from  a  table 
of  random  numbers,  thus  each  had  an  equal  probability  of 
being  misreccgnized .  The  data  suggests  that  the  pntries 
0,  2,  4,  and  5  are  over-represented  while  the  entries  9  and 
3  are  under-represented. 
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APPiNEIX  A 
T600  VOCABULARY  LIST 


T600 

T600 

Location 

Output 

Register 

000 

zero 

001 

one 

002 

tvo 

003 

three 

004 

four 

005 

five 

006 

six 

007 

seven 

008 

eight 

009 

nine 

010 

control 

011 

rrodify 

012 

enter 

013 

yes 

014 

no 

015 

alfa 

016 

bravo 

017 

charl ie 

016 

left 

019 

right 
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APPENEIX  B 


SCRIPT  &  INSTRUCTIONS  TO  SUBJECTS 


1)  The  CRT  and  the  integrated  Keyboard  (1KB)  you  see 
here  are  similiar  tc  these  found  at  the  navigator's  position 
in  the  B-52G.  I  will  oe  measuring  your  aoility  to  load 
target  information  in  actual  ALCM  formats  using  keyboard  and 
voice  entry.  The  experiment  is  divided  into  two  parts. 
Part  I  will  require  you  to  load  20  ALCM  target  sets  using 
both  the  1KB  and  voice  entry.  Part  II  will  require  you  to 
call  up  each  of  six  ALCM  target  sets  I  have  preloaded,  and 
mate  corrections  to  them  if  necessary  with  new  values  you 
will  have  in  front  of  you.  This  will  be  done  three  times, 
each  with  a  different  CRT  display  format. 

2)  Show  photos  (Figures  3,4)  of  navigator's  position  in 
B-52G-.  Show  actual  1KB  (Figure  5j  and  the  working  model 
used  in  experiment  (Figure  6). 

3)  If  the  voice  unit  is  used  first,  train  the  20 
vocabulary  words  at  this  time.  Explain  the  theory  of  voice 
entry.  After  words  have  been  trained,  have  subject  repeat 
each  three  times,  confirming  the  voice  unit  can  understand 
at  least  two  out  of  the  three  utterances.  For  each  word 
failing  the  above  test,  have  subject  retrain  that  word. 

4)  Show  subject  typical  ALCM  target  sets.  Run  practice 
computer  program.  Show  subject  how  to  call  up,  enter, 
modify,  etc.,  target  sets. 


You  have  as  much  tirre  as  you  feel  is  necessary  to 
practice.    When  you  feel  comfortable  with  the  procedure,  we 

will  proceed  with  Part  I  cf  the  experiment. 

(Answer  any  questions  and  assist  if  necessary.) 

5)  Tou  will  be  given  20  ALCM  target  sets  printed  en  3 
sheets  of  paper.  When  I  say,  "reaay,  begin",  enter  the  sets 
as  fast  as  possible  while  maintaining  accurate  inputs.  If 
you  make  a  mistake,  be  sure  to  correct  it. 

Any  questions?   Ready,  begin. 

6)  Repeat  above  paragraphs  (4)  and  (?)  using  other 
entry  method,  after  subject  completes  a  ten  minute  break. 

?)  We  will  now  begin  Part  II  of  the  experiment.  I  have 
preloaded  18  ALCr"  target  sets  in  three  groups  of  six.  You 
will  be  given  each  set  of  these  six  target  sets  separately 
on  a  sheet  cf  paper  with  seme  cf  the  values  changed.  You 
will  be  required  to  display  each  target  set  on  the  CRT, 
compare  it  tc  the  corresponding  target  set  en  the  paper,  and 
make  the  necessary  corrections  to  the  target  set  on  the  CRT. 
Some  target  sets  will  require  no  corrections,  while  others 
will  require  many.  Each  group  of  six  target  sets  will  be 
displayed  on  the  CRT  in  cne  of  three  ways:  single-  spaced, 
double-spaced,  or  inverse-viaeo . 

Show  subject  example  of  ALCM  target  sets  with  changed 
values  on  a  sheet  of  paper.  Run  practice  corrputer  program. 
Allcw  subject  to  practice  until  he  is  comfortable  with  the 
procedure . 
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You  have  as  rruch  tirre  as  you  feel  is  necessary  to 
practice.  When  ycu  feel  comfortable  with  the  procedure,  we 
will  proceed  with  Part  II  of  the  experiment. 

(Answer  any  questions  and  assist  if  necessary.) 

8)  Hepeat  item  #7  if  subject  fails  to  understand  Part 
II  of  the  experiment. 

If  you  make  a  mistake,  be  sure  to  correct  it. 

Any  questions?   Ready,  begin. 

y)  Repeat  above  paragraphs  (7)  and  (6)  using  other 
entry  rrethod. 


APPENDIX  C 
EXPERIMENTAL  ORDER  FOR  SUEJECTS 

SUBJECTS  1,3,5,7,9,11,13,15,17,19  performed  Part  II   of   the 
experiment  in  the  following  order: 

Target  Leading  Task  -  Voice, Key  beard 

SUEJECTS  2, 4, 6, 8, 10, 12, 14, 16,1c, 20  performed  Part  II  of   the 
experiment  in  the  following  order: 

Target  Loading  Task  -  Key  board , Voice 

SUBJECTS   1,2,3,5,8,7,9,11,13   performed   Part   II  of        the 
experiment  in  the  following  order: 

Target  Information  Verification  Task  - 
Single-Spaced,  Double-Spaced,  Inverse-Video 

SUBJECTS  15,17,19,4,6  performed  Part  II  of  the  experiment  in 

the  following  order: 

Target  Information  Verification  Task  - 
Double-Spaced,  Inverse-Video,  Single-Spaced 

SUBJECTS   10,12,14,16,18,20   performed   Part    II    of    the 

experiment  in  the  following  order: 


Target  Information  Verification  Task  - 
Inverse-Video,  Single-Spaced,  Double-Spaced 

Note:   All  twenty  subjects  performed  first 
Part  I,  "Target  Loading  Task".   This 
was  followed  by  Part  II,  "Target 
Information  Verification  Task". 
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APPENDIX  D 

SUBJECT  DATA  SHUTS 
TARGET  LOADING  TASK  DATA  SHEET 

NAI^E:   RANK: 

DATE:  SERVICE: 


ACCURACY 
IAT 


OAT 


IAV 


OAV 
VOICE  or  KEYEOARD 
NME  =  NMC 

tMCE 


TNE 


%  Correct  Entries 
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TARGET  LOADING  TASK  DATA  SHEET 


CIRCLE  CNE:    VOICE 


KEYBOARD 


WEA.# 
Al 

NIC  !  NMC  ; 

!  NME  ; 

TIME  !  NICE  I           NEUTCE            j 
min.           line#         #entries   ! 

i      M  i                            i 
!      Ni                             ! 

A2 

:         j         ; 

|      M  j                             i 
i      Ni                           ! 

A3 

I      M  j                            ! 

In!                      ! 

A4 

1     n  I                      ! 

In!                     1 
_    _  i _ i 

A5 

I     M !                      ! 
N !                      ! 

A6 

!     M !                      I 
In!                    1 

Bl 

!     M  1                        I 

N  !                        1 

E2 

:         '         : 

I      M|                              | 
I      Ni                              I 

1              | 

B3 

>         1         ■ 

!     N !                     ! 

B4 

:                   1                   : 

I     m  !                      ! 

I      N|                             | 

BS 

| 

I      M  !                          1 
I      N  I                              I 

Be 

1                   . 

I      M  |                          ! 
N  I                              1 

B? 

1 

I      M  !                              1 
i     Ni                        ! 

Be 

1 

1      M  |                          ! 
i      N  i                            I 
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TARGET  LOADING  TASK  DATa  SHEET  (cont.) 


CIRCLE  ONE:    VOICE     KEYBOARD 


WEA.#    [    NIC    |    NMC    ; 
[              !    NME 

TIM    !    MCE                              NEUTCE                            | 
min.                    !         line#                     #entries      ! 

ci                      ; 

[Ml                                                          ! 
In!                                                 ! 

C2                      ; 

1                 i              M  j                                                                    ! 

In!                                                 ! 

C3 

i          m  !                                                    ! 
In!                                                 ! 

C4                      ; 

1            M  j                                                          ! 

N !                                                      ! 

C5                     ! 

i              M  i                                                                        I 

!           N !                                                    ! 

r                            : 

C6    [         i        ; 

!m!                                                     j 
i           N|                                                     ! 

?y 


TARGET  INFORMATION  VERIFICATION  TATA  SHEET 


CIRCLE  ONE:  SINGLE-SPACED   DOUBLE-SPACED   INVERSE-VIDEO 


ACCURACY 

IAT 

OAT 

KEYBOARD 

NME  =  NMC 

NCE 

TNE 

Correct  Entries: 
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TARGET  INFORMATION  VERIFICATION  DATA  SHEET 


WEA.#  [  #  Incorrect  Char.!  NIC  J  TIME     NICE    !  NEUTCE 

[  to  be  changed  out  I  ]  min.            j 

Al  [  6  !  ]                ! 

A2  [  3  ]  !          ! 

A3  [  8  !  ] 

A4  [  3  !  ]  I           ! 

A5  [  6  ]                 i 

A6  [  0  ill 

Bl  [  3  ili          I 

B2  [  4  I  ]  ! 

B3  [  9  ]  |           j 

B4  [  4  !  ] 

B5  [  3  !  ]  !           i 

E6  [  3  ]  i           ! 

B7  [  9  i  J  !           ! 

B8  5  !           i 
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TARGET  INFORMATION  VERIFICATION  EATA  SHEET  (cont.) 


WEA.#    [   #    Incorrect   Char.!    NIC 
[    to    de    changed    out! 

]    TIME    !         NICE         !    NEUTCE     | 
min .    !                         !                    ! 

ci                 0                       ; 

it                         ii 

It                         ii 

i                         i                    i 

I                i                         ii 

C2                           6                       ! 

i                         i                    i 

I                i                         i                    * 
i                         i                    i 

i                i                         ii 

C3     [                1                   i           ! 

i                         i                    i 

i                         ii 
i                         i                    i 

i                    i 

C4       [                    5                       ! 

i                         i                    i 
i                         i                    i 
i                         i                    i 
i                         i                    i 
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APPENDIX  E 


TARGET  LOADING  TASK  INPUT  DATA  LIST 


WEAPON  Al 


N31864725 
E 467214085 

1965430873 

97031667439 

61498 


WEAPON  A 2 


N 19857435 

E973687525 

1210934753 

53272361071 

40912 


WEAPON  A3 


1  N56672130 

2  E120957264 

3  1295725482 

4  07362756364 

5  28158 


WEAPON  A4 


N62659374 
E59832616fa 
3871946572 
26386610864 

16452 


WEAPON  A5 


N 10725497 

E728552S47 

1650724572 

75189473575 

£6836 


WEAPON  A6 


1  N  16500364 

2  E660375724 

3  0734712641 

4  16406437553 

5  65838 
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WEAPON  El  : 


N 17896354 

E194653653 
5481937906 
64868351041 
86357 


WEAPON  B2  : 


N52849654 

E107452749 

1075382657 

63956272651 

20756 


WEAPON  E3  : 


1 

2 
•x 

4 

5 


M3474638 

E385638361 

6120346246 

01852954752 

65820 


WEAPON  B4 


1  N01472863 

2  E 184644278 

3  1038565275 

4  07452865375 

5  15832 


WEAPON  B5 


N86612086 
E68 1902642 
1943026474 
02857918491 
65821 


WEAPON  E6 


1  N 10238475 

2  E027361856 

3  7453298136 

4  06164829154 

5  68264 


WEAPON  E7  : 


N02746382 

E578103656 

5482107462 

10825483217 

62741 
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WEAPON  B8 


1  N58286106 

2  E193656628 

3  1037561937 

4  18401746218 

5  51073 


WEAPON  CI 


1  N 10354826 

2  E102462651 

3  6295016472 

4  39741845226 

5  12275 


WEAPON  C2 


N  17494625 

E629575107 

4610374628 

10617361561 

19565 


WEAPON  C3 


N56194015 
E4528 08462 
9108265726 
51072658254 
753e2 


WEAPON  C4 


1  N01735473 

2  E107562743 

3  1656264634 

4  519562710C4 

5  61028 


WEAFON  C5 


N10741970 

1963557254 

5629601652 

51036582514 

62614 


WEAPON  C6 


N66952753 

E106385672 

1653903647 

01758265781 

01536 
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APPENDIX  F 

TARGET  INFORMATION  VERIFICATION  TASK 
PRELOADED  TARGET  SETS 

Summary  of  #characters/line  to  be  cbanged  out: 

Seven  hundred  seventy-four  total  characters  are  possible 
to  be  changed  out  in  all  18  target  sets.  A  value  of  10%  was 
chosen  to  be  changed  out  by  each  subject.  Ten  percent  of 
77<i  =  78 ,  the  number  chosen  to  be  cbanged  out. 

All  eighteen  target  sets  were  divided  intc  three  groups 
of  six  target  sets/display  method.  Each  of  the  three  groups 
had  26  characters  tc  be  changed  out.  Characters  to  be 
changed  out  were  selected  randomly. 


WEAPON  Al 


1  Ne2746382 

2  E578 103856 

3  5462107462 

4  10825483217 

5  62741 


#Characters/line  to 
be  changed  out : 


5 
0 

1 

0 
0 


WEAPON  A2 


1  N10354826 

2  E102462651 

3  6295016472 

4  39741845226 

5  10275 


1 
1 
0 
1 

e 
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#Characters/line  to 
be  changed  out : 


WEAPON  A3 


1  N82659374 

2  E598326188 

3  3871946572 

4  £8386610664 

5  18452 


0 
5 
3 
0 
0 


WEAPON  A 4 


N31864725 

E467214085 

1965430873 

97031687439 

61496 


0 
0 
1 
2 

0 


WEAPON  A5  : 


1  N 13474638 

2  E385638361 

3  6120346246 

4  01852954752 

5  65620 


1 
2 

1 
1 
1 


WEAPON  A6 


N01472863 

E184644276 

1038565275 

07452865375 

15832 


0 
0 
0 

0 
0 


WEAPON  Bl 


N 17494625 

E629575107 
4C1037462S 
10817381561 
19565 


1 
0 
2 

0 
0 


weapon  b; 


1  N56672130 

2  E120957264 

3  1£95725482 

4  07362756364 

5  28158 


1 
2 
0 
1 
0 
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#Characters/line    to 
be  changed    out  : 


WEAPON 

B3  : 

1 
2 

4 

N 10238475 

E027361656 

7453298136 

08164829154 

68264 

WEAPON 

B4  : 

1 
2 

4 

N66952753 

E106385672 

1653903647 

01758265761 

01538 

WEAPON 

B5  : 

1 
2 
3 

4 
5 

N17494625 

E629575107 

4610374628 

10817381561 

19565 

WEAPON 

26  : 

1 
2 

w 

4 

c 

N  19857435 

E973667525 

1210934753 

53272361071 

40912 

WEAPON 

B7  : 

1 

2 

3 
4 
5 

N 17896354 

E194653853 
5461937906 
64868351041 
66357 

WEAPON 

E8  : 

1 
2 

"< 
«j 

4 

5 

N58266108 

E193656828 

1037561937 

18401746216 

51073 

2 

7 
0 
0 

0 


e 

0 
i 
l 

2 


1 
0 
2 
0 
0 


3 

0 
0 
0 
0 


1 
6 
2 

0 
0 


4 
1 

0 
0 

0 
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#Characters/line  to 
be  changed  out : 


WEAPON  CI 


N 01472863 

1184644276 
1036565275 
07452865375 

15832 


0 
0 
0 
0 

0 


WEAPON  C2 


1  N107254b*7 

2  E728552547 

3  1650724572 

4  75189473575 

5  £6836 


2 

1 

0 
0 

3 


WEAPON  C3 


1  N52849654 

2  E107452749 

3  1075382657 

4  63956272651 

5  20756 


0 
1 
0 
0 
0 


WEAPON  C4 


N 56194015 

E452606462 
9108265726 
51072656254 
75382 


0 
2 
0 
0 
3 
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APPENDIX  G 

REVISED  1ARGET  SETS  TO  ES  UPDATED  IN  PART  II 

TARGET  INFORMATION  VERIFICATION  TASK 

SINGLE-SPACED  DISPLAY  FORMAT 


WEAPON  Al  : 


1  N07342394 

2  E578103B56 

3  5^82107462 

4  10825483217 

5  62741 


WEAPON  A2 


1  N 10254826 

2  E102462671 

3  6295016472 

4  09741845226 

5  10275 


WEAPON  A3 


1  N62659374 

2  E758826381 

3  2773946571 

4  28366610664 

5  18452 


WEAPON  A4 


N31864725 

E467214085 

1965430473 

92001687439 

61498 


WEAPON  A 5 


1  N 13424638 

2  E185638371 

3  6160346246 

4  01852854752 

5  35820 


WEAPON  A 6 


N01472663 

E184644278 

1038565275 

07452665375 

15832 
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DOUBLE-SPACED   DISPLAY    FOBKAT 


WEAPON  Bl 


N17694625 

E629575107 

4610375676 

10617381561 

19565 


WEAPON  B 


c 


N56672630 
E022957264 
1295725482 
07362756314 
2b  158 


WEAPON  B3 


1  N 16236375 

2  E175340833 

3  7453298136 

4  08164829154 

5  66264 


WEAPON  E4  : 


1  N66952753 

2  E 106385672 

3  1253903647 

4  01758265061 

5  21548 


WEAPON  B5 


N 17694625 

E629575107 

4612375678 

10617361561 

19565 


WEAPON  B6  : 


N 15867495 

E973687525 

1210934753 

53272361071 

40912 
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INVERSE-VIDEO    DISPLAY    FOBMAT 


WEAPON 

B7    : 

1 
2 

•7 

4 

N77896354 

E990353146 

5421937106 

64868351041 

86357 

WEAPON 

E8    : 

1 
2 

4 

N57486001 

E196656628 

1037561937 

18401746218 

51073 

WEAPON 

CI    : 

1 

2 
3 

4 

5 

N01472863 
E 184644278 
1038565275 
07452865375 
15832 

WEAPON 

C2    : 

1 
2 

T 

I* 

4 

N 17724497 

E82855254? 

1850724572 

75169473575 

29637 

WEAPON 

vw    • 

1 

2 

4 
5 

N 52849654 

E109452749 

1075382657 

63956272651 

20756 

WEAPON 

C4    : 

1 
2 
3 
4 
5 

N56194015 

E852808461 

9106265726 

51072658254 

77669 
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APPENEIX  H 
EXPERIMENTAL  LATA 

TABLE  VIII 

SUBJECT  ERRORS  -  TARGET  LOAEING  TASK 

(1KB) 


SUB.# 

NIC 

NEC 

NICE 

NMC 

NCE 

TNE 

%  CORRECT  ENTR. 

1 

0 

9 

y 

2 

1351 

1381 

%y?.e     ! 

2 

0 

44 

0 

0 

1316 

1448 

%90.y    ! 

3 

0 

6 

6 

1 

1354 

1378 

%98.2 

4 

46 

R 

51 

48 

130y 

1375 

%yi.y 

5 

0 

£ 

6 

0 

1352 

1444 

%93.e    ! 

6 

7 

10 

-< 

1350 

1376 

%97.9      ! 

7 

0 

6 

e 

0 

1354 

1371 

%ye.e    ! 

6 

43 

2 

45 

45 

1315 

1366 

%y3.2 

y 

2 

10 

12 

27 

1348 

i3yy 

%y4.5    ! 

10 

5 

u 

10 

0 

1350 

1366 

%y7.4 

n 

0 

1 

1 

0 

isey 

1362 

%99.8      ! 

12 

47 

c 

62 

90 

i2ye 

1374 

%88.7      ! 

13 

0 

4 

4 

0 

1356 

1368 

%yy.i     ! 

14 

2 

c^ 

0 

1355 

13y4 

%97.2      ! 

15 

0 

22 

22 

0 

1338 

1438 

%93.0      ! 

16 

36 

17 

53 

46 

1307 

I3y0 

%yi.0     ! 

17 

0  . 

1 

1 

0 

i35y 

1362 

£96.8      ! 

18 

1 

g 

7 

0 

1  TRT 

X  W  w  1^ 

1381 

%98.0 

19 

19 

e 

£7 

17 

1  ^^1 

J.  V^  W  i_ 

I36y 

%94.6 

20 

0 

s 

e 

0 

1352 

1383 

%97.8      ! 

LEGEN 


D: 


NIC: 

Number 

NEC: 

Number 

NICE: 

Number 

NMC: 

Number 

NCE: 

Nurter 

tn: 


Incorrect  Characters 
Entries  Corrected 
of  Incorrect  Entries  =  NIC 
Missing  Characters  (same  as 
Correct  Entries 


•  NEC 

NME) 


Total  Number  Errors 
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TABLE  IX 


SUBJECT  ERRORS:  TARGET  LOADING  TASK 


(VOICE) 


SUB.# 

j  NIC 

j  NEC 

!  NICE 

i  NMC 

i  NCE 

i  TNE 

\%    CORRECT  ENTR. 

1 

1 

1   4 

i  3y 

i   0 

!  1321 

1368 

%99.0      ! 

2 

2 

iy 

60 

7 

!  1300 

1412 

%91.6 

3 

1 

17 

74 

0 

!  1286 

1413 

%91.0 

4 

4 

7 

4y 

2 

i  1311 

i3ys 

%93.6      ! 

5 

21 

73 

7 
o 

i  1287 

1442 

%89.0      ! 

e 

8 

6 

47 

7 

i  1313 

13y2 

%y3.y     ! 

7 

2y 

50 

0 

!  1310 

1420 

%92.3      ! 

6 

1 

10 

32 

45 

!  134y 

1408 

%92.6      ! 

y 

0 

17 

81 

2 

!  127y 

1430 

%89.3      ! 

10 

4 

23 

51 

0 

!  i30y 

1440 

%90.9      | 

ni 

1 

21 

81 

0 

!  I27y 

1418 

%90.2      ! 

12 

0 

18 

44 

0 

!  1316 

I3yy 

%94.1      ! 

*12 

e 

C 

41 

45 

i  1319 

1378 

%92.7      ! 

14 

i 

5 

22 

e 

i  1338 

13y2 

%96.1      ! 

*l£ 

7 

43 

ey 

10 

!  1271 

144y 

%87.1      ! 

16 

9 

17 

108 

0 

I  1252 

1444 

%86.7      j 

"•l  7 

3 

27 

118 

0 

!  1242 

1436 

%86.5      ! 

it  ! 

c 

16 

41 

10 

1319 

1400 

%93.5      ! 

*19 

1 

y 

0 

!  1325 

1391 

22  i 

14 

38 

110  , 

y 

,  1250 

1449  | 

%85.7      | 

LEGEND: 

NIC: 

Nun.  be  r 

NEC: 

Number 

NICE: 

Nurber 

NMC: 

Nurber 

NCE: 

Nunber 

TNE: 

Total 

Incorrect  Characters 
Entries  Corrected 
of  Incorrect  Entries  =  NIC  +  NEC 
Missing  Characters  (sarre  as  NME) 
Correct  Entries 
Nurber  Errors 
Previous  Experience  with  Voice  Input 


(The  voice  portion  of  NICE  also  includes  the  number 
of  voice  unit  ncnrecognitions  and  missrecogni tions ) 
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TABLE  X 


SUBJECT  ERRORS:  TARGET  INFORMATION  VERIHCATION  TASK 


(SINGLE-SPACED  ECRMAT) 


SUE.# 

NIC 

NEC 

MCE 

NMC 

NCE 

TNE 

%  CORRECT  ENTR. 

1 

0 

C 

1 

125 

130 

%95.4      ! 

C 

0 

0 

0 

0 

130 

130 

%100.0      ! 

3 

0 

0 

0 

1 

130 

132 

%97.7      ! 

4 

0 

0 

0 

120 

130 

%100.0      | 

4 

1 

C 

0 

11? 

130 

%90.0      i 

6 

0 

0 

1 

1 

129 

130 

%98.5      ! 

? 

0 

0 

0 

0 

130 

132 

%96.5      ! 

& 

1 

0 

1 

0 

129 

130 

%92.3      ! 

9 

0 

0 

0 

0 

130 

130 

%100.0      ! 

10 

0 

1 

1 

0 

129 

132 

%97.?      ! 

11 

0 

6 

6 

1 

124 

145 

%84.9      ! 

12 

0 

0 

0 

0 

130 

130 

%100.0 

13 

0 

1 

1 

0 

129 

132 

%9?.7 

14 

4 

1 

5 

0 

125 

132 

%94 . 7      ! 

15 

0 

"7 

3 

0 

12? 

150 

%84.6      ! 

16 

0 

1 

1 

1 

129 

138 

%92.8      ! 

1? 

2 

2 

4 

0 

126 

132 

%95.5 

16 

0 

0 

0 

0 

130 

130 

%100.0      ! 

iy 

0 

0 

0 

0 

120 

132 

%98.5 

20 

1 

0 

1 

1 

129 

130 

n)*9C  •  « 

LEGEND: 


NIC:  Nuirber    Incorrect    Characters 

NEC:  Nurrber   Entries   Corrected 

NICE:  Nurrber    of    Incorrect    Entries    =   NIC    +   NEC 

NMC:  Nurrber  hissing  Characters    (sarre   as   NME) 

NCE:  Nunber   Correct   Entries 

TNE:  Total   Number   Errors 
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TABLE  XI 


SUBJECT  ERRORS:  TARGET  INFORMATION  VERIFICATION  TASK 


(DOUBLE-SPACEE  iORMAT) 


SUB.# 

NIC 

NEC 

1  NICE 

NMC 

NCE 

1  TNE 

%  CORRECT  ENTR. 

1 

0 

4 

I    4 

i   1 

128 

I  141 

1     £99.1      ! 

2 

0 

0 

0 

e 

132 

136 

%97.1 

i 

u 

1 

c 

6 

0 

126 

141 

%89.4      j 

4 

1   5 

0 

5 

0 

127 

132 

%96.2      ! 

5 

0 

0 

0 

0 

132 

132 

%100.0      ! 

6 

2 

1 

3 

0 

129 

134 

%96.3      ! 

7 

0 

1 

1 

0 

131 

134 

%97.8 

6 

1 

0 

1 

0 

131 

134 

%96.3      ! 

y 

1 

1 

4 

0 

126 

138 

%92.8      ! 

le 

1 

1 

2 

1 

130 

134 

%96.3      ! 

n 

0 

1 

1 

1 

131 

134 

%97.0      ! 

ik 

0 

T 
o 

3 

0 

129 

134 

%96.3      ! 

13 

1 

1 

2 

1 

130 

138 

%93.5      ! 

14 

3 

1 

4 

1 

126 

144 

%ee.3    ! 

15 

0 

1 

1 

1 

131 

137 

%94.9      ! 

16 

1 

4 

5 

2 

127 

140 

%89.4      ! 

17 

0 

3 

1 

129 

147 

%87.2      ! 

18 

1 

Ik 

4 

0 

128 

137 

%93.4      | 

19 

1 

2 

3 

0 

129 

136 

%94.9      ! 

20 

0 

3   i 

3 

0 

I2y 

136 

%93.£      ! 

LEGEND:   NIC:  Number  Incorrect  Characters 

NEC:  Number  Entries  Corrected 

NICE:  Nurrber  of  Incorrect  Entries  =  NIC  +  NEC 

NMC:  Number  Missing  Characters  (same  as  NME) 

NCE:  Nurrber  Correct  Entries 

TNE:  Total  Number  Errors 
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TABLE  XII 


SUBJECT  ERRORS:  TARGET  INFORMATION  VERIFICATION  TASK 


INVERSE-VIDEO  FOBMAT) 


SUB.# 

NIC 

!  NEC 

NICE 

NMC 

NCE 

TNE 

%  CORRECT  ENTR. 

1 

0 

0 

0 

0 

115 

115 

%100.0      ! 

2 

2 

0 

0 

0 

115 

121 

%95.0      ! 

3 

0 

0 

0 

0 

115 

115 

%100.0      ! 

4 

0 

0 

0 

3 

115 

115 

£97.5      | 

5 

7 

0 

7 

0 

108 

115 

%93.9      ! 

6 

0 

0 

0 

c 

115 

115 

%96.3      j 

7 

0 

1 

1 

0 

114 

125 

£91.2      ! 

e 

0 

0 

0 

0 

115 

115 

%100.0     ! 

9 

0 

1 

0 

0 

114 

117 

%97.4      ! 

10 

0 

2 

2 

0 

113 

119 

%95.0      ! 

n 

18 

0 

18 

0 

97 

115 

%84.3      i 

12 

5 

7 

0 

108 

115 

%93.9      ! 

13 

0 

7 

7 

0 

108 

121 

%89.3      ! 

14 

3 

1 

4 

1 

111 

127 

%66.7      ! 

15 

0 

0 

0 

0 

115 

118 

%y7.5     ! 

16 

9 

■^ 

i* 

12 

1 

103 

124 

%62.4      ! 

17 

2 

0 

2 

0 

113 

115 

%98.3      ! 

ie 

0 

0 

0 

0 

115 

115 

%100.0      ! 

19 

1 

2 

3 

0 

112 

120 

'..  w  <_  .  v_                | 

20 

1 

0 

1 

0 

114 

115 

%99.1      ! 

LEGEND:   NIC:  Nunber  Incorrect  Characters 

NEC:  Number  Entries  Corrected 

NICE:  Nurrber  of  Incorrect  Entries  =  NIC  +  NEC 

NMC:  Nurber  Missing  Characters  ( sarre  as  NME) 

NCE:  Number  Correct  Entries 

TNE:  Total  Number  Errors 
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TABLE  XIII 


ERRORS*  TURING  VOICE  ENTRY 


SUB.# 

i 
i 

TARG 

ET  SETS 

!  TOTAL 

1-5 

6-10  ! 

11-15  ! 

16-20 

1 

e 

6   ! 

16    ! 

10 

i   38    j 

z 

17 

19   ! 

23    j 

y 

68 

3 

14 

i   26   ! 

21    ! 

11 

72 

4 

7 

12   ! 

13    ! 

13 

45    ! 

e 

19 

16 

18 

15 

70    j 

6 

y 

11   ! 

e   ! 

y 

!   37    | 

7 

12 

ii  ! 

6   ! 

6 

y   ! 

6 

7 

y 

6    i 

7 

2y   | 

y 

13 

is  ! 

24 

26 

81 

10 

ie 

7   ! 

10   ! 

13 

1   46    ! 

n 

12 

18 

15    j 

14 

5y   ! 

12 

n 

y 

6   ! 

y 

i   35    j 

13 

12 

T             1 

KS                    1 

ii   ! 

7 

33    j 

14 

4 

4 

2    I 

7 

17    ! 

15 

13 

6 

7    ! 

13 

3y   ! 

16 

6 

2y 

28    j 

17 

60 

17 

17 

17   ! 

28    ! 

26 

88    ! 

18 

2   j 

6    ! 

y 

20    ! 

19 

6 

y  ! 

7    ! 

3 

25    ! 

20 

Ik) 

12  ! 

(X 

23 

48    ! 

mean : 

10.7 

12.5  ! 

12.7   ! 

13.0 

sd: 

4.6 

7.6  ! 

7.S   ! 

6.3 

*  Ncnrec eg niticns  ard  Mis recognitions 


ye 


TABLE  XIV 
NCNRECOGNITIONS  OF  UTTERANCES  BY  ENTRY 


ENTRY 

TOTAL  NONRECCGNITICNS j 

0 

92           ! 

1 

!          49           | 

2 

86                          j 

•7 

31           j 

4 

107          ! 

5 

82          ! 

6 

44           i 

7 

32           ! 

e 

40 

y 

24 

control 

32 

modify 

iy 

enter 

59 

yes 

4         ! 

alpha 

6           i 

bravo 

16          ! 

Charlie 

0 

left 

17          ! 

right 

32           ! 

yy 


TABLE  XV 
NONRECOGNITIONS  01  UTTERANCES  EY  SUBJECT 


SUB.  : 

! TOTAL  NONRECOGNITIONS! 

1 

i          34           ! 

c 

39 

3 

—  <-           i 

4 

36           ! 

48           ! 

6 

23 

7 

18           ! 

8 

16          ! 

y 

63          j 

10 

20           ! 

n 

53           ! 

12 

23           | 

13 

27           J 

14 

15          ! 

15 

39 

16 

81          ! 

17 

80 

18 

20 

19 

25           ! 

^0   ! 

58           ! 

120 
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